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Abstract-- In this paper, the rectangular features of an 
image are considered for generation of feature set and 
compared with the existing techniques. The orientation 
features are extracted for the establishment of feature set 
for image indexing and retrieval. The identification and the 
representation of textures present in the image under 
analysis are performed with auto-correlation coefficients 
by estimating the model parameters for small image 
regions. The feature is generated and matching is done by 
measuring distance between two images using Euclidean 
distance classification. The experiments are carried out on 
the standard images using MATLAB. The result shows 
that proposed method provides better retrieval rate when 
compared with the existing methods such as Local Tetra 
Patterna and Local Ternary Pattern Method. 
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1. INTRODUCTION 

Edge based image retrieval is one of the best 
approaches for image retrieval system. The extraction of edges 
in 2D monochrome images based on the proposed Full Range 
Auto Regressive Model is first presented in this chapter and is 
extended for subsequent effective image retrieval. 

Generally, an edge is defined as a boundary point or 
outermost area of an object. In image retrieval, edge plays a 
major role. The retrieval process is done by detecting the 
edges, computing their values and performing the low-level 
tasks such as identification, classification, matching, 
segmentation, compression and boundary detection. In 
general, edges are characterized by an abrupt change in the 
gray value of an image and they are classified as roof edges 
and step edges. 

2. LITERATURE SURVEY 

In the literature, many reviews on edge detection are 
reported and various algorithms are proposed for edge 
extraction in gray level images. Edge detection methods are 
classified into enhancement /threshold type, gradient based 
operators, edge-fitting, edge detection, zero-crossings in 
second order derivatives, curve fitting approach, optimally 
criterion approach and residual based techniques. 

The enhancement/threshold type is well-known for 
its simplicity and low computational complexity. The gradient 
values of different orders are calculated by convolving the 
various gradient operators. The gradient based operators such 
as Roberts [16], Prewitt [13] and Sobel [21] are well known 



and widely used to find the step edges rather than the roof 
edges. All these operators are first order derivatives. 

Hueckel [7] proposed a method for edge-fitting and 
edge detection and later it has been simplified by Rosenfeld 

[17] . Though the gradient based operators are computationally 
simple and amenable to the hardware implementation, the 
Laplacian operator, which is a second order derivative is 
mostly used to establish the location of edges present in the 
image. This operator cannot be used in its natural form for 
edge detection. 

Instead, it is applied with the Gaussian function 
which is known as Laplacian of Gaussian (LoG) function [11]. 

Goshtasby et al., [5] proposed a curve-fitting 
approach for edge detection in which the parametric curves 
are being used to represent the edge contours and fitted to the 
high-gradient image pixels with its weight proportional to the 
gradient magnitude of the pixels. 

Krishnamoorthi et al., [8] used the curve fitting 
model based on zero-crossing in the second order derivatives 
and claimed that the technique is superior to the vector order 
statistics and entropy schemes in color images. Sarkar et al., 

[18] reported that the edge detectors are based on optimality 
criterion. 

Canny’s [1] operator is very much popular among all 
the edge detectors and it uses Gaussian filter for smoothing 
the image before extracting the edges. 

Ding et al., [DingOl] have proved that the Canny’s 
algorithm cannot capture the branching edges and edge 
junctions, but it captures the spurious edges. 

Grimson et al., [6] introduced a residual analysis 
approach for computer vision applications and suggested the 
zero-crossings of the residual results in locating the edges. 

Subsequently, [9] have analysed and reported the 
differences between the original and the smoothed version, 
which are the important feature detectors to extract edges in 
gray scale images [10]. 

Chen et al., [2] considered the distribution of 
residuals and found auto correlation for the residual by which 
they could extract the edge features. 

Zheng et al., [24] proposed a hybrid edge detector 
with the combination of gradient and zero-crossing based on 
Least Square Support Vector Machine (LS-SVM) with the 
Gaussian filter. It is reported that it takes lesser time than the 
Canny’s detector with similar performance on edge extraction. 
In the earlier works, the threshold is chosen on heuristic basis 
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for edge detection. Even in the Canny’s edge detector the 
default value of the upper limit is suggested to be 75th 
percentile of the gradient strength. 

Rakesh et al., [15] reported that this problem has 
been overcome in their work, but their algorithm needs initial 
threshold value and parameters as an input. Several methods 
have been proposed for edge detection with marking points in 
a digital image. Most of the algorithms typically convolute a 
filter operator, and then map overlapping input image regions 
to output signals which lead to a considerable loss in edge 
detection. Even Gaussian filter suffers with some problems 
such as edge displacement, vanishing edges and false edges. 

Shashank Mathur et. al., [19] have proposed an 
application model based on fuzzy logic that helps to deal with 
problems with imprecise and vague information. 

Dong-Su Kim et al. [4] proposed a procedure to 
determine the edge magnitude and direction which are found 
in the (3 x 3) ideal binary pattern for a block. The average 
value is calculated for the pixels in a (3 x 3) block, and 
compared with each pixel in the block. If the pixel is greater 
than the average value then it is marked as 1, otherwise it is 
marked as 0. Then, they proposed fixed weight such as (1, 2, 
4, 8, 16, 32, 64 and 128) for the 8-neigbouring pixels 
depending on their zonal position related to the centre pixel 
and formulated an 8-bit code by adding the weight of the 
pixels which are marked as 1. This is not justifiable because 
the pixel values in a (3 x 3) block generally influence the 
centre pixel more or less equally. In this approach, they used 
the weight 1 to the pixel in the location (1, 1) and 128 to the 
pixel in the location (3, 3). 

3. EXISTING METHODOLOGY 

3.1 LOCAL TETRA PATTERNS 

Local Tetra Patterns for the application of content- 
based image retrieval. This method encodes the spatial 
relationship between the referenced pixel and its neighbors, 
which is based on the first order derivatives, along vertical and 
horizontal directions. The 8 bit tetra pattern for each center 
pixel is formulated, then separate all patterns into four parts 
based on the direction of center pixel. Finally, the tetra 
patterns for each direction are converted into three binary 
patterns. Similarly, the other tetra patterns for remaining three 
directions (2, 3 and 4) are converted to 12 binary patterns. 

3.2 LOCAL TERNARY PATTERNS 

Conventional LBP is extended to a three - valued 
code called as LTP. It preserves more textural information 
than LBP. This descriptor perceives the number of transitions 
or discontinuities in the circular presentation of the patterns. 
When such transitions are found to follow a rhythmic pattern, 
they are recorded as uniform LTP. 

3.3 PROPOSED METHODOLOGY 

The feature extraction is an important process to 
make efficient image indexing and retrieval. Hence an 
enhanced technique is used to extract the feature and represent 
image as a template for image recognition and retrieval. 



3.3.1 ORIENTATIONAL FEATURE 

There are various models and methods are available 
for image indexing and retrieval but not sufficient for 
providing accuracy in recognition process. To develop an 
image indexing and retrieval system features extracted based 
on orientation and autocorrelation features of an image. In 
order to improve the efficiency of the image retrieval system 
using low-level salient features embedded in the edges are 
extracted. 




Fig.1 Process flow 

In general, matching of texture based image is carried 
out with the similarity between the areas of the images with 
similar texture. The technique that has been used for 
measuring texture similarity is done by calculating the relative 
brightness of selected pairs of pixels from each image. From 
these it is possible to measure texture features of the image 
such as the degree of contrast, coarseness, directionality and 
regularity, or periodicity, directionality and randomness. 
Texture queries can be formulated in a similar manner to color 
queries, by selecting examples of desired textures from a 
palette or by supplying a query image. The system then 
retrieves images with texture measures which are most similar 
to the query. 

If the primitives are large, the function decreases 
slowly with increasing distance where as it decreases rapidly 
if texture consists of small primitives. The auto-correlation 
function is defined as: 



M -r - 1 N-c 



Y E «" (>. j~>S ° (' + r, j + c) 



A(r,c) = 



—(3.1) 



(M - r)(M -c) „ „ 

h i « ('. l)S ('. j) 



Here g u represents the zero-mean image of the gray 
level image g(r,c) of size M X N and computed by the 
equation [g°=g(r,c)-mean of g]. Nature of function value 
reveals the presence of texture pattern and its periodicity of 
representation. However, if the primitives are periodic, then 
the autocorrelation increases and decreases periodically with 
distance. The set of autocorrelation coefficients [G c ff] are 
modeled to extract the texture features as below: 
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Here the position difference in the i. j direction is 
denoted by p and q respectively and their value ranges from 
(0,0) to (r-l,s-l) such that 1 < r < M/2 and 1 < s < N/2.The 
gray scale image with M X N dimension is considered for 
computation. 

When the positional difference (p,q) varies from (0,0) 
to (r-l,s-l) the extracted texture feature is represented as a 
matrix as shown below: 

F cff (p,q) = (G Jf (r,s))::l m _, (3.3) 

s = 0..n — 1 

In order to represent the identified micro textured 
regions, the autocorrelation coefficients are calculated using 
the equation 3.2 and are stored in an array for various sub- 
images. The computed autocorrelation values range from 0 to 
1. A simple transformation (P*100) is applied on the 
autocorrelation values to obtain decimal number that range 
from 0 to 100, where P is the autocorrelation coefficient. 



3.3.2 AUTOCORRELATION FUNCTION 

In statistics, the autocorrelation function of a random 
process describes the correlation between the processes at 
different points in time. Let X, be the value of the process at 
time t (where t may be an integer for a discrete time process or 
a real number for a continuous-time process). If X t has Mean 
p and variance O 2 then the definition of the ACF is 

. , E[(X t -v)(X -v)\ 

R (t, s) = LV * — [ s — — 

ct2 ...(3.4) 

The expression is not well-defined for all time series. 
Since the variance O 2 may be zero (for a constant process) or 
infinite. If the function R is well defined its value must lie in 
the range [-1,1], with 1 indicating perfect correlation and -1 
indicating perfect anti-correlation. 

If X, is second-order stationary then the ACF 
depends only on the difference between t and s can be 
expressed as a function of a single variable. This gives 
R ^ E[(X i -y)(X i+k -u)\ 

° 2 ...(3.5) 

Where k is the tag l(t-s)l. It is common practice in 
many disciplines to drop the normalization by G 2 and use the 
term autocorrelation interchangeably with auto-covariance. 

For a discrete time series of length n{Xi, X 2 , X n } 

with known Mean and Variance, an estimate of the 
autocorrelation may be obtained as 



...(3.6) 

for any positive integer k<n. When the true Mean p 
is known, this estimate is unbiased. However, if the true Mean 
and variance of the process are not known and p and O 2 
replaced by the standard formulae. For sample mean and 
sample variance, then this estimate is biased. An alternative 
way a period gram based estimate replaces n-k in the above 
formula with n. This estimate is always biased it usually has a 
smaller Mean square error. In image processing, the above 



definition is often used without the normalization without 
subtracting the Mean and dividing by the variance. When the 
autocorrelation function is normalized by mean and variance, 
it is sometimes referred to as the autocorrelation coefficient. 
Multi-dimensional autocorrelation is defined similarly. 

3.3.3 HORIZONTAL DIRECTIONALITY 

In the proposed model, the texture horizontal 

directionality of each block of size (n x n) is computed by 
applying q = 0 in the equation (3.2). The auto correlation 
coefficients on horizontal directionality is modeled and 

converted into autonums and are represented as 

F hff (p,0) = (G ff (r,0)r: = o.. m -i -(3.7) 

3.3.4 VERTICAL DIRECTIONALITY 

In the proposed model, the texture vertical 

directionality of each block of size (n x n) is computed by 
applying p = 0 in the equation (3.2). The auto correlation 
coefficients on horizontal directionality is modeled and 

converted into autonums and are represented as 

Fyff(0,q) = (G ff (0,s)) n s=0 n _, -(3.8) 



3.3.5 RECTANGULAR FEATURES 

The rectangular grid of each sub-image is represented 
in a matrix of size (mxn) as shown in the equation 
[X if tbs prscrtE cf ttepc arra wtlintbs gicl 



/(viH- 



Q dbavase 



...(3.9) 



G m , n = o..,,,-! ...(3.10) 

n = 0..n-l 

The general features such as area, perimeter, centroid 
and mass are computed for rectangular grid in which it 
satisfies (4 of presence of shape and represented by f ri where 
i=l..k. 



3.3.6 GENERATION OF FEATURE SET 

The feature set is generated with the orientation 
image based feature vectors for all the sub images. The 
features of each blocks of the sub image and are represented 
as below. 

Fori ~ { F c ff, F hc g , F vc g, f rk } ...(3.11) 

Hence, the obtained orientation features values of 
each block are represented. Then the feature vectors are 
obtained with the values as mentioned in equation 3.11. Here, 
the orientation feature set generation is considered for the 
recognition and retrieval. The extracted feature set of the 
block of the target image is obtained. 

3.4 PROPOSED ALGORITHM 

The entire retrieval procedure with the orientation 
features is presented as simple algorithms hereunder using 
MATLAB. In two phases the orientation feature, of the 
images from the databases, are used. In the algorithm-I, 
procedure to establish feature set is established for each of the 
images. In algorithm-II, the image retrieval procedure that 
retrieves top ‘m’ images from the IDB corresponding to the 
target image is presented. 
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3.4.1 Algorithm - 1 

//generating feature sets H 
Input: Input image size from IDB 
Output: Feature database 
Begin 

Step 1: Read an image from the image database (IDB) 
of size MxN. 

Step 2: Divide the input image into non-overlapping 
blocks of size. 

Step 3: Perform procedure ori _ feature ( ) 

Step 3: Perform procedure auto_ corr ( ) 

Step 4: Repeat Stepl through Step4 for all the images in 
IDB. 

Step 5: Establish feature database set 

End 



3.4.2 Algorithm-ll 

//Retrieving top m relevant images corresponding to 
the target image// 

Input : Target Image 

Output : Resultant Image 

Begin 

Step 1: Select the target image of size MxN and divide 
into blocks. 

Step2: Repeat Step3 and Step 4 in algorithm I. 
Step3:Compute the Euclidean distance between the 
target image and the image set for matching 
using the equation 3.13. 

Step 4: Compute the Precision and Recall using the 
equation 3.14 and equation 3.15. 

Step 5: Stop 
End 



H procedure auto correlation U 
Procedure auto_Corr () 

{ 

Step 1: Read an input image from the image 
database. 

Step 2: Compute the positional difference by using 
equation 5.16 

Step3: Establish feature Matrix with the auto 

correlation features for all the K sub regions 
of the input image as discussed in equ.3.2 
Step 4: Return 

} 



// Procedure Orientation Feature// 

Procedure ori_feature ( ) 

Begin 

Step 1 : Identify the closed edges of the input image with 
rectangular grid. 

Step 2: Fill the grid values either “7 ” for presence of 
rectangular (or) “0” for other. 

Step 3 : Eliminate the shape present in the rectangular 
grid if the area less than 'A of the bounded 
rectangular grid area and count no. of shape (n) 
for feature extraction. 

Step 4: Establish the horizontal feature matrix with the 
auto correlation features of the input image as 
discussed in section 3.3.2. 

Step 5: Establish the vertical feature matrix with the 
auto correlation features of the input image as 
discussed in section 3.3.4. 

Step 6 : Calculate rectangular based general features such 
as centroid area, perimeter and mass of selected 
K th rectangular grid area as discussed in the sub 
section for 3.3.5. 

Step 7: Establish the rectangular based general feature 
set are computed as mentioned in equation 3.10 

Step 8: Calculate the features set of the input image as 
mentioned in equation 3.11. 

Step 9: Repeat Step2 through Step6 for all the input 
images and find the feature vectors of each 
rectangular features. 

Step 10: Return 

End 



4. EXPERIMENTATION & RESULTS 



The experimentation is carried out by MATLAB. To 
validate the effectiveness of the proposed orientation feature 
based image retrieval system, experimentation is performed 
with the images in the CORAL image database that contains 
five hundred 2-D monochrome images of same size. The total 
images are grouped into 40 classes with 10 images in each 
class. 
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Fig 2. Images Considered for Experimentation 

5. SIMILARITY AND PERFORMANCE MEASURES 

To find the similarity measures between the images, 
various metrics are used to measure the distance between 
features of the images. Some of the well known distance 
metrics used in for image retrieval is presented below. The 
Euclidean Distance is calculated as below 

d E (x l ,x 2 )= X(x 1 (/)-x 2 (0) 2 

» '=> ...(3.12) 

Where x , (i ) is the feature vector of input image i and 
x 2 (i) is the feature vector of the target image i in the image 
database. 

In the texture based image retrieval system Euclidean 
distance is used to find the distance between the features 
vectors of the target image I t and each of the image in the 
image database (1,). The difference between two images Ii and 
It can be expressed as the distance ‘d’ between the respective 
feature vectors Fs(I,) and Fs(I t ). 

From the given input image I; and the target image I t 
the Euclidean Distance is calculated as, 




Where Fs(Ii) is the feature set of the input image Ii, 
Fs(I t ) is the n-dimensional feature vector of the target image I, 
respectively. 

Precision 

Precision measures the fraction of retrieved 
documents that are relevant to a specific query and is 
analogous to positive predictive value. 

No. of relevant images retrieved 

P(%)= x 100 -(3.14) 

Total no. of images Retrieved 

Recall 

Recall measures the fraction of all the relevant 
documents in a collection that are retrieved by a specific query 
and similar to the concept of sensitivity. Here, recall is the 
number of figure captions that were indexed by a concept 
divided by the number of captions in which the concept was 
actually present. 

No. of relevant images retrieved 

R (%) = x 100 - (3.15) 

Total no. of relevant images in DB 



6. PERFORMANCE EVALUATION 

The proposed feature extraction is experimented with 
the images collected from the standard database CORAL 
consisting of 1000 images are of the size ( m x n) as shown in 
fig. 2. From the below Table 1.1 shows that recognition 
percentage of query images with Proposed Model gives the 
higher retrieval accuracy of 65.13%. The performance was 
evaluated using the Euclidean Distance classification by 
analysis of the values in the table the Proposed model is better 
for image retrieval. 



Table 1.1 Comparison Values 



Methods 


Recognition 


Local Binary Pattern(LBP) [24] 


43.62 


Local Tetra Patterns (LTP) [24] 


49.05 


Local Ternary Patterns(LTrPs) [24] 


48.79 


Proposed Orientation Model 


65.13 



From the below figure shows the pictorial 
representation of the performance evaluated. By analyzing the 
obtained results the Proposed Model produced the best results. 




Fig.3 Comparison Graph with Existing Model 



Hence, the retrieval rate is estimated in terms of 
precision and recall. The precision and recall of the proposed 
method is presented in the following table. The performance 
of the existing schemes with precision and recall are also 
obtained. For every comparison, they are also incorporated in 
the same Table 4.2. 



Table 1.2 Comparison Result 



Method 


Precision 


Recall 


GLCM [23] 


0.72 


0.54 


Law’s Method [23] 


0.81 


0.68 


Proposed 
Orientation Model 


1.06 


0.13 


The above Table 


1.2 shows the 


precision and recall 



of the proposed model in which the proposed model provides 
the precision 1.06 and recall 0.13 which is better than GLCM 
and Laws method respectively. Hence, the proposed model is 
also efficient for image retrieval. 



1.2 




GLCM [23] Law’s Method [23] Proposed Model 



Fig.4 Comparison Graph with Existing Model 
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The fig.4 shows the pictorial representation of the 
evaluated performance of the image retrieval. By analyzing 
the obtained results the Proposed Model produces better 
results. 

7. CONCLUSION 

In this paper, integrated model is extended for the 
edge based image retrieval. The feature sets of the non- 
textured images are generated with Distance edge orientation 
histogram sequences of the edge map and are stored in the 
feature database. The images are then retrieved from the 
image database with the edge orientation features. In order to 
achieve the proposed edge based image retrieval are been 
tested with different image databases. The results are 
compared with the existing methods. 
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